General Models of Usability 3 EFFICIENCY MEASURES MEASURES MINIMIZE COSTS QUALITATIVE SUCCESS MAXIMIZE TASK MAXIMIZE USER SATISFACTION

نویسندگان

  • Marilyn Walker
  • Candace Kamm
  • Diane Litman
چکیده

The design of methods for performance evaluation is a major open research issue in the area of spoken language dialogue systems. This paper presents the PARADISE methodology for developing predictive models of spoken dialogue performance, and shows how to evaluate the predictive power and generalizability of such models. To illustrate the methodology, we develop a number of models for predicting system usability (as measured by user satisfaction), based on the application of PARADISE to experimental data from three diierent spoken dialogue systems. We then measure the extent to which the models generalize across diierent systems, diierent experimental conditions, and diierent user populations, by testing models trained on a subset of the corpus against a test set of dialogues. The results show that the models generalize well across the three systems, and are thus a rst approximation towards a general performance model of system usability.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The proposed cost and profit models in presence of flexible measures

In conventional DEA, measures are classified as either input or output. However, in some real cases there are variables whose status is not known as input or output before assessment. These variable are known as flexible measures. One of the most important economic dimensions for ensuring the success of a company is the efficiency with which it uses its resources. Therefore, centering on Asses...

متن کامل

Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics

OBJECTIVE Mobile health (mHealth) systems are becoming more common for chronic disease management, but usability studies are still needed on patients' perspectives and mHealth interaction performance. This deficiency is addressed by our quantitative usability study of a mHealth diabetes system evaluating patients' task performance, satisfaction, and the relationship of these measures to user ch...

متن کامل

Evaluating Spoken Language Systems

Spoken language systems (SLSs) for accessing information sources or services through the telephone network and the Internet are currently being trialed and deployed for a variety of tasks. Evaluating the usability of different interface designs requires a method for comparing performance of different versions of the SLS. Recently, Walker et al (1997) proposed PARADISE (PARAdigm for DIalogue Sys...

متن کامل

Usability Metrics of Time and Stress - Biological Enhanced Performance Test of a University Wide Learning Management System

This paper describes the modification and outcome of a performance test applied to a university wide learning management system under realistic conditions to identify usability problems and to compare measures such as success rate, task time and user satisfaction with requirements. Two user groups with 20 test users each took part in this study. During the whole test psychophysiological paramet...

متن کامل

Optimization of Agricultural BMPs Using a Parallel Computing Based Multi-Objective Optimization Algorithm

Beneficial Management Practices (BMPs) are important measures for reducing agricultural non-point source (NPS) pollution. However, selection of BMPs for placement in a watershed requires optimizing available resources to maximize possible water quality benefits. Due to its iterative nature, the optimization typically takes a long time to achieve the BMP trade-off results which is not desirable ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2000